Visual sensor fusion for active security in robotic industrial environments

This work presents a method of information fusion involving data captured by both a standard CCD camera and a ToF camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time of light information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localization. Further development of these methods will make it possible to identify objects and their position in the real world, and to use this information to prevent possible collisions between the robot and such objects

3D point cloud registration based on a purpose-designed similarity measure

This article introduces a novel approach for finding a rigid transformation that coarsely aligns two 3D point clouds. The algorithm performs an iterative comparison between 2D descriptors by using a purpose-designed similarity measure in order to find correspondences between two 3D point clouds sensed from different positions of a free-form object. The descriptors (named with the acronym CIRCON) represent an ordered set of radial contours that are extracted around an interest-point within the point cloud. The search for correspondences is done iteratively, following a cell distribution that allows the algorithm to converge toward a candidate point. Using a single correspondence an initial estimation of the Euclidean transformation is computed and later refined by means of a multiresolution approach. This coarse alignment algorithm can be used for 3D modeling and object manipulation tasks such as "Bin Picking" when free-form objects are partially occluded or present symmetries

Working together: a review on safe human-robot collaboration in industrial environments

After many years of rigid conventional procedures of production, industrial manufacturing is going through a process of change toward flexible and intelligent manufacturing, the so-called Industry 4.0. In this paper, human-robot collaboration has an important role in smart factories since it contributes to the achievement of higher productivity and greater efficiency. However, this evolution means breaking with the established safety procedures as the separation of workspaces between robot and human is removed. These changes are reflected in safety standards related to industrial robotics since the last decade, and have led to the development of a wide field of research focusing on the prevention of human-robot impacts and/or the minimization of related risks or their consequences. This paper presents a review of the main safety systems that have been proposed and applied in industrial robotic environments that contribute to the achievement of safe collaborative human-robot work. Additionally, a review is provided of the current regulations along with new concepts that have been introduced in them. The discussion presented in this paper includes multidisciplinary approaches, such as techniques for estimation and the evaluation of injuries in human-robot collisions, mechanical and software devices designed to minimize the consequences of human-robot impact, impact detection systems, and strategies to prevent collisions or minimize their consequences when they occur

Accurate estimation of airborne ultrasonic time-of-flight for overlapping echoes

In this work, an analysis of the transmission of ultrasonic signals generated by piezoelectric sensors for air applications is presented. Based on this analysis, an ultrasonic response model is obtained for its application to the recognition of objects and structured environments for navigation by autonomous mobile robots. This model enables the analysis of the ultrasonic response that is generated using a pair of sensors in transmitter-receiver configuration using the pulse-echo technique. This is very interesting for recognizing surfaces that simultaneously generate a multiple echo response. This model takes into account the effect of the radiation pattern, the resonant frequency of the sensor, the number of cycles of the excitation pulse, the dynamics of the sensor and the attenuation with distance in the medium. This model has been developed, programmed and verified through a battery of experimental tests. Using this model a new procedure for obtaining accurate time of flight is proposed. This new method is compared with traditional ones, such as threshold or correlation, to highlight its advantages and drawbacks. Finally the advantages of this method are demonstrated for calculating multiple times of flight when the echo is formed by several overlapping echoes.This work has been supported by the Spanish Government projects DPI2006-15313 and DPI2012-36959

Ultrasonic Sensors in Urban Traffic Driving-Aid Systems

Currently, vehicles are often equipped with active safety systems to reduce the risk of accidents, most of which occur in urban environments. The most prominent include Antilock Braking Systems (ABS), Traction Control and Stability Control. All these systems use different kinds of sensors to constantly monitor the conditions of the vehicle, and act in an emergency. In this paper the use of ultrasonic sensors in active safety systems for urban traffic is proposed, and the advantages and disadvantages when compared to other sensors are discussed. Adaptive Cruise Control (ACC) for urban traffic based on ultrasounds is presented as an application example. The proposed system has been implemented in a fully-automated prototype vehicle and has been tested under real traffic conditions. The results confirm the good performance of ultrasonic sensors in these systems

Improved underwater stereo reconstruction by turbidity characterization

[Resumen] Este trabajo se centra en realizar un completo análisis de imágenes de objetos característicos en entornos subacuáticos con diferentes grados de turbidez, con el objetivo de mejorar la calidad de las imágenes que faciliten el posterior reconocimiento de objetos y cálculo de su posición respecto al vehículo subacuático mediante técnicas de visión estereoscópica. Para ello, se ha analizado el comportamiento de un conjunto de evaluadores de la calidad mediante una batería de imágenes tomadas con distintos niveles de turbidez para posteriormente poder determinar la influencia de las técnicas de filtrado en la correspondencia estéreo. De esta manera, se puede obtener una reconstrucción más densa de los objetos que permita determinar con mayor precisión la posición de estos con referencia al vehículo subacuático y servir tanto de ayuda al operador humano como para la generación de trayectorias de navegación autónoma.[Abstract] This work focuses on performing a complete image analysis of characteristic objects in underwater environments with different degrees of turbidity, with the aim of improving the quality of the images to facilitate the subsequent recognition of objects and calculation of their position with respect to the underwater vehicle using stereoscopic vision techniques. For this purpose, the behavior of a set of quality evaluators has been analyzed using a battery of images taken with different levels of turbidity in order to determine the influence of filtering techniques on the stereo correspondence. In this way, a denser reconstruction of the objects can be obtained, allowing to determine their position with reference to the underwater vehicle with greater precision and to serve both as an aid to the human operator and for the generation of autonomous navigation trajectories.Ministerio de Ciencia e Innovación; TED2021-132158B-I0

Monovision-based vehicle detection, distance and relative speed measurement in urban traffic

This study presents a monovision-based system for on-road vehicle detection and computation of distance and relative speed in urban traffic. Many works have dealt with monovision vehicle detection, but only a few of them provide the distance to the vehicle which is essential for the control of an intelligent transportation system. The system proposed integrates a single camera reducing the monetary cost of stereovision and RADAR-based technologies. The algorithm is divided in three major stages. For vehicle detection, the authors use a combination of two features: the shadow underneath the vehicle and horizontal edges. They propose a new method for shadow thresholding based on the grey-scale histogram assessment of a region of interest on the road. In the second and third stages, the vehicle hypothesis verification and the distance are obtained by means of its number plate whose dimensions and shape are standardised in each country. The analysis of consecutive frames is employed to calculate the relative speed of the vehicle detected. Experimental results showed excellent performance in both vehicle and number plate detections and in the distance measurement, in terms of accuracy and robustness in complex traffic scenarios and under different lighting conditions

Proyecto de captación de estudiantes para el Grado de Gestión de PYMES

Memoria ID-0203. Ayudas de la Universidad de Salamanca para la innovación docente, curso 2015-2016